Display control method, information processing server, and display terminal

ABSTRACT

A display control method performed using a system including an information processing server includes: (a) obtaining, using a sensor, a user state indicating whether a user is currently cooking using a cooker, when an image of a delivery person delivering an item to a building in which the user is present is captured by a camera provided at an entrance door of the building; (b) obtaining content information of the item; (c) obtaining at least one suggestion associated with the user state and the content information of the item; and (d) causing a display terminal provided in the building to display the image of the delivery person, the content information of the item, and the at least one suggestion. Here, (a) to (d) are performed by the information processing server.

CROSS REFERENCE TO RELATED APPLICATIONS

This application is a U.S. continuation application of PCT InternationalPatent Application Number PCT/JP2018/047763 filed on Dec. 26, 2018,claiming the benefit of priority of U.S. Provisional Patent ApplicationNo. 62/611,109 filed on Dec. 28, 2017 and priority of Japanese PatentApplication Number 2018-200429 filed on Oct. 24, 2018, the entirecontents of which are hereby incorporated by reference.

BACKGROUND 1. Technical Field

The present disclosure relates to a display control method, aninformation processing server, and a display terminal for controllingdisplay of a suggestion regarding reception of an item from a deliveryperson who delivers the item to a building in which a user is present.

2. Description of the Related Art

There is a conventional technique of displaying an image captured by acamera provided at the entrance door of a building, on a displayterminal in the building. For example, Japanese Unexamined PatentApplication Publication No. 2017-220795 discloses a video door phonedevice for stable wireless communication between an indoor master unitand an entrance slave unit. With such a video door phone device, when,for example, a delivery person arrives at the door of a building andactivates an intercom, an image of the delivery person captured by theentrance slave unit is displayed on the display of the indoor masterunit.

SUMMARY

A display control method according to an aspect of the presentdisclosure is a display control method performed using a systemincluding an information processing server, and the display controlmethod includes: (a) obtaining, by the information processing server,using a sensor, a user state indicating whether a user is currentlycooking using a cooker, when an image of a delivery person delivering anitem to a building in which the user is present is captured by a cameraprovided at an entrance door of the building; (b) obtaining, by theinformation processing server, content information of the item; (c)obtaining, by the information processing server, at least one suggestionassociated with the user state and the content information of the item;and (d) causing, by the information processing server, a displayterminal provided in the building to display the image of the deliveryperson, the content information of the item, and the at least onesuggestion.

Note that these general or specific aspects may be implemented using asystem, a device, an integrated circuit, a computer program, or acomputer-readable recording medium such as a CD-ROM, or any combinationof systems, devices, integrated circuits, computer programs, orrecording media.

BRIEF DESCRIPTION OF DRAWINGS

These and other objects, advantages and features of the disclosure willbecome apparent from the following description thereof taken inconjunction with the accompanying drawings that illustrate a specificembodiment of the present disclosure.

FIG. 1 is an external view of an information processing system andperipheral devices according to Embodiment 1;

FIG. 2 is a block diagram illustrating a functional configuration of theinformation processing system according to Embodiment 1;

FIG. 3 illustrates an example of first data according to Embodiment 1;

FIG. 4 illustrates an example of second data according to Embodiment 1;

FIG. 5 illustrates an example of third data according to Embodiment 1;

FIG. 6 is a flow chart illustrating processing of the informationprocessing system according to Embodiment 1;

FIG. 7 illustrates an example of a camera image according to Embodiment1;

FIG. 8 illustrates an example of a first screen according to Embodiment1;

FIG. 9 illustrates an example of a second screen according to Embodiment1;

FIG. 10 illustrates an example of a third screen according to Embodiment1;

FIG. 11 illustrates an example of a fourth screen according toEmbodiment 1;

FIG. 12 illustrates an example of a fifth screen according to Embodiment1;

FIG. 13 illustrates an example of another screen according to Embodiment1;

FIG. 14 illustrates an example of another screen according to Embodiment1;

FIG. 15 illustrates an example of another screen according to Embodiment1;

FIG. 16 illustrates an example of another screen according to Embodiment1;

FIG. 17A illustrates an overview of a service providing system accordingto Embodiment 2;

FIG. 17B illustrates an example of a data center operating companyaccording to Embodiment 2;

FIG. 17C illustrates an example of a data center operating companyaccording to Embodiment 2;

FIG. 18 illustrates service type 1 (company-owned data center) accordingto Embodiment 2;

FIG. 19 illustrates service type 2 (IaaS-based) according to Embodiment2;

FIG. 20 illustrates service type 3 (PaaS-based) according to Embodiment2; and

FIG. 21 illustrates service type 4 (SaaS-based) according to Embodiment2.

DETAILED DESCRIPTION OF THE EMBODIMENTS

Hereinafter, embodiments will be described in detail with reference tothe accompanied drawings.

Note that the following embodiments each illustrate a general orspecific example. The numerical values, shapes, materials, constituentelements, the arrangement and connection of the constituent elements,steps, the processing order of the steps, etc. illustrated in thefollowing exemplary embodiments are mere examples, and are therefore notintended to limit the scope of the claims. Among the constituentelements in the following embodiments, those not recited in any one ofthe independent claims representing the most generic concepts will bedescribed as optional constituent elements. Note that the drawings arerepresented schematically and are not necessarily precise illustrations.Throughout the drawings, constituent elements that are essentially thesame share like reference signs, and overlapping descriptions thereofare omitted or simplified.

The following describes the knowledge forming the basis of aninformation processing system and method according to the presentdisclosure. The inventor has considered the actions that a user wouldtake when a delivery person comes. When a delivery person comes, theuser takes different actions depending on the user's situation.Meanwhile, the user is required to take a prompt action in response tothe delivery person. In view of this, an information processing systemand method according to the present disclosure provide the user withinformation about the delivery to make it easier for the user todetermine the action that the user wants to take. Additionally, aninformation processing system and method according to the presentdisclosure simplify the user's action by providing the user with asuggestion to expedite the user's action, and controlling devicesaccording to the user's response to the suggestion displayed. That is tosay, the inventor has conceived an information processing system andmethod which display, on one screen, both information about the deliveryand a suggestion for expediting the user's action, to facilitate boththe user's understanding of the situation and the user's action.

Embodiment 1

[Configurations of Information Processing System and Peripheral Devices]

First, configurations of an information processing system and peripheraldevices according to Embodiment 1 will be described with reference toFIG. 1 to FIG. 5. FIG. 1 is an external view of an informationprocessing system and peripheral devices according to Embodiment 1. FIG.2 is a block diagram illustrating a functional configuration of theinformation processing system according to Embodiment 1.

Information processing system 10 includes information processing server100 and one or more display terminals including display terminal 200.Information processing server 100 and one or more display terminals arecommunicably connected to one another. Hereinafter, display terminal 200will be described as a representative of the one or more displayterminals, and description of the rest of the display terminals will beomitted.

Information processing system 10 is communicably connected to camera300, electronic lock 400, information terminal 500, cooker 600, sensor700, first database 801, second database 802, and third database 803.

Information processing server 100 is, for example, a cloud server, andcauses display terminal 200 to display at least one suggestion based ona user state.

Display terminal 200 includes a display, and displays, on the display,at least one suggestion received from information processing server 100.In the present embodiment, display terminal 200 is provided on a wallsurface in a building. Alternatively, display terminal 200 may be amobile terminal.

Camera 300 is provided at entrance door 30 of the building. In FIG. 1,camera 300 is built into a door phone. For example, camera 300 capturesan image of delivery person 50 who delivers item 40 to the building inwhich user 20 is present. The building includes, for example, aresidence, an apartment building, an office building having a pluralityof offices, a commercial building having a plurality of shops, and ahotel having a plurality of rooms. Entrance door 30 of an apartmentbuilding may be an entrance door of each residence, or may be anentrance door of the apartment building. Entrance door 30 of an officebuilding may be an entrance door of each office, or may be an entrancedoor of the office building. Likewise, entrance door 30 of a commercialbuilding may be an entrance door of each shop, or may be an entrancedoor of the commercial building.

Electronic lock 400 is a lock capable of remote control on the openingand closing of entrance door 30 of the building. Electronic lock 400 isalso referred to as an electronic key. Electronic lock 400 controls theopening and closing of entrance door 30 based on a lock/unlock signalfrom information processing system 10.

Information terminal 500 is a terminal usable by delivery person 50.Information terminal 500 is a handy terminal carried by delivery person50, for example. Information terminal 500, for example, receives arequest for redelivery of item 40 from information processing system 10.Information terminal 500 may be provided at entrance door 30, forexample.

Cooker 600 is a device used when user 20 cooks. Cooker 600 is, forexample, a microwave oven, a cooking stove, or the like. Cooker 600 cancontrol power ON and OFF based on a signal from information processingsystem 10.

Sensor 700 transmits to information processing system 10 a sensor valueused for obtaining a user state indicating whether user 20 is currentlycooking using cooker 600. Specifically, sensor 700 is, for example, animage sensor which is provided in the building and captures an image ofthe inside of the building. Sensor 700 may be, for example, an ON/OFFsensor which detects power ON and OFF of cooker 600.

First database 801 is a storage device storing first data 801 a whichassociates sensor values and user states for each of a plurality ofusers. Specifically, first database 801 is, for example, a databaseserver which includes a processor, memory, and a hard disk drive.

Here, first data 801 a will be described using a specific example. FIG.3 illustrates an example of first data 801 a according to Embodiment 1.

In FIG. 3, first data 801 a includes user information, sensor value, anduser state. User information is information that identifies users.Sensor value represents an image pattern, for example. User stateindicates whether a user is currently cooking. According to first data801 a in FIG. 3, the user state is determined to be cooking when Pattern1 is included in an image of the user identified as USER 1.

Second database 802 is a storage device storing second data 802 a whichassociates (i) a plurality of pieces of identification information or aplurality of scheduled delivery dates and times and (ii) pieces ofcontent information of a plurality of items. Specifically, seconddatabase 802 is, for example, a database server which includes aprocessor, memory, and a hard disk drive.

Here, second data 802 a will be described using a specific example. FIG.4 illustrates an example of second data 802 a according to Embodiment 1.

In FIG. 4, second data 802 a includes ID, scheduled delivery date andtime, image information, and urgent flag. ID is an example ofidentification information for identifying content information.Scheduled delivery date and time indicates a date and time of scheduleddelivery of an item.

Image information is identifier information which identifies an image ofan item (for example, a uniform resource identifier (URI)). Urgent flagis an example of urgent information indicating whether the delivery ofthe item is urgent. For example, the urgent flag is set by the user whenthe user purchases an item via a website. Here, urgent flag 1 indicatesthat the delivery is urgent, whereas urgent flag 0 indicates that thedelivery is non-urgent. The image information and the urgent flagcorrespond to the content information of the item.

It can be seen from second data 802 a in FIG. 4 that, for example, theimage of an item identified by 000001 is . . . /image01.jpg, and thatthe delivery of this item is urgent. It can also be seen that the imageof an item scheduled to be delivered on 2018/10/30 at 12:00 is . . ./image01.jpg, and that the delivery of this item is urgent.

Third database 803 is a storage device storing third data 803 a whichassociates (i) a plurality of combinations of a user state and contentinformation of an item and (ii) a plurality of suggestion sets eachincluding at least one suggestion. Specifically, third database 803 is,for example, a database server which includes a processor, memory, and ahard disk drive.

Here, third data 803 a will be described using a specific example. FIG.5 illustrates an example of third data 803 a according to Embodiment 1.

Third data 803 a in FIG. 5 includes user state, urgent flag, firstsuggestion, and second suggestion. User state indicates whether the useris currently cooking. As in FIG. 4, urgent flag is an example of urgentinformation indicating whether the delivery of the item is urgent.According to third data 803 a in FIG. 5, when, for example, the userstate is Cooking and the urgent information indicates Yes, the firstsuggestion of Cooker OFF and the second suggestion of Unlock areobtained.

[Configuration of Information Processing Server]

Next, a configuration of information processing server 100 will bedescribed. As illustrated in FIG. 2, information processing server 100includes processor 101, memory 102, and communication unit 103.

Processor 101 is an electric circuit connected to memory 102. When animage of delivery person 50 delivering item 40 to the building in whichuser 20 is present is captured by camera 300 provided at entrance door30 of the building, processor 101 obtains, using sensor 700, a userstate indicating whether user 20 is currently cooking using cooker 600.Processor 101 further obtains content information of item 40. Processor101 then obtains at least one suggestion associated with the user state,and causes display terminal 200 to display the image of delivery person50, the content information of item 40, and at least one suggestion. Thedetails of the processing will be described later using a flow chartetc.

Memory 102 is, for example, a semiconductor memory and/or a hard diskdrive. Memory 102 can store a software program or an instruction.

When the software program or the instruction stored in memory 102 isexecuted, processor 101 can perform the processing described above.

Communication unit 103 is a network adapter for performing one or bothof wired communication and wireless communication with display terminal200, camera 300, electronic lock 400, information terminal 500, cooker600, sensor 700, first database 801, second database 802, and thirddatabase 803 via a communication network. The communication network maybe, for example, the Internet, a wide area network (WAN), a local areanetwork (LAN), or any combination of these. Wireless communication mayuse wireless LAN, Bluetooth (registered trademark), ZigBee (registeredtrademark), or any combination of these.

[Configuration of Display Terminal]

Next, a configuration of display terminal 200 will be described. Asillustrated in FIG. 2, display terminal 200 includes processor 201,memory 202, communication unit 203, display 204, and input unit 205.

Processor 201 is an electric circuit connected to memory 202. Processor201 displays, on display 204, an image of delivery person 50, contentinformation of item 40, and at least one suggestion which are receivedfrom information processing server 100.

Memory 202 is, for example, a semiconductor memory and/or a hard diskdrive. Memory 202 can store a software program or an instruction. Whenthe software program or the instruction stored in memory 202 isexecuted, processor 201 performs various processing.

Communication unit 203 is a network adapter for performing one or bothof wired communication and wireless communication with informationprocessing server 100 via a communication network.

Display 204 displays the image of delivery person 50, the contentinformation of item 40, and at least one suggestion which are receivedfrom information processing server 100. For example, display 204 is aliquid crystal display or an organic EL display.

Input unit 205 is an input device used for receiving user input. Forexample, input unit 205 is a touch panel (that is, a touch screen)provided integrally with display 204. Input unit 205 may be, forexample, a mechanical button, a mouse, a keyboard, or any combination ofthese and a touch panel.

[Operation of Information Processing System]

Next, processing of information processing system 10 configured asdescribed above will be described with reference to FIG. 6 to FIG. 12.FIG. 6 is a flow chart illustrating processing of the informationprocessing system according to Embodiment 1.

[Step S101]

Processor 101 of information processing server 100 obtains an image ofdelivery person 50 from camera 300 (hereinafter also referred to as acamera image). FIG. 7 is an example of camera image 301 according toEmbodiment 1. In FIG. 7, camera image 301 includes delivery person 50and item 40. Camera image 301 also includes sheet 41 on whichidentification information identifying content information of item 40 isprovided. For example, the identification information is provided onsheet 41 in the form of a bar code and/or a character string.

[Step S102]

Processor 101 of information processing server 100 obtains the contentinformation of item 40. Specifically, processor 101 first obtains theidentification information from camera image 301. Then, processor 101obtains the content information of item 40 based on the obtainedidentification information, by referring to second data 802 a. Forexample, processor 101 obtains 000001 as the identification informationby reading the bar code provided on sheet 41 of camera image 301. Then,by referring to second data 802 a in FIG. 4, processor 101 obtains, asthe content information of item 40, image information . . . /image01.jpgand urgent flag 1 which are associated with 000001.

Note that processor 101 does not necessarily need to obtain the contentinformation of item 40 based on the identification information. Forexample, processor 101 may obtain the content information of item 40based on the date and time of obtainment of the image, by referring tosecond data 802 a. For example, when camera image 301 was captured at11:55 on Oct. 30, 2018, processor 101 may obtain, as the contentinformation of item 40, image information . . . /image01.jpg and urgentflag 1 which are associated with the scheduled delivery date and time2018/10/30 12:00 which is closest to the actual capturing date and time.

[Step S201]

Processor 101 of information processing server 100 obtains a sensorvalue that is an output value of sensor 700. When sensor 700 is an imagesensor, for example, processor 101 obtains image data as the sensorvalue. When sensor 700 is an ON/OFF sensor, for example, processor 101obtains an ON/OFF signal as the sensor value.

[Step S202]

Processor 101 of information processing server 100 obtains a user stateusing sensor 700. Specifically, processor 101 obtains a user state basedon a sensor value obtained by sensor 700, for example. Morespecifically, processor 101 obtains a user state based on a sensor valueby referring to first data 801 a. At this time, processor 101 mayidentify the user based on the sensor value, and obtain a user statebased on the identified user and the sensor value by referring to firstdata 801 a.

For example, when sensor 700 is an image sensor, processor 101recognizes the user based on image data. The method for user recognitionis not particularly limited, and a conventional technique may be used.For example, processor 101 identifies user 20 as USER 1. Here, when theimage data includes Pattern 1, processor 101 obtains, by referring tofirst data 801 a in FIG. 3, a user state indicating that user 20 iscurrently cooking using cooker 600.

When, for example, sensor 700 is an ON/OFF sensor and processor 101obtains an ON signal, processor 101 obtains a user state indicating thatuser 20 is currently cooking using cooker 600. On the other hand, whenprocessor 101 obtains an OFF signal, processor 101 obtains a user stateindicating that user 20 is not cooking using cooker 600.

[Step S301]

Processor 101 of information processing server 100 determines at leastone suggestion. Specifically, processor 101 obtains at least onesuggestion associated with the user state and the content information ofitem 40. For example, processor 101 obtains, by referring to third data803 a, at least one suggestion associated with the obtained user stateand content information of item 40.

For example, when the user state indicates that the user is currentlycooking, and the urgent information included in the content informationof item 40 indicates that the delivery is urgent, processor 101 obtains,by referring to third data 803 a in FIG. 5, a first suggestion to turnoff cooker 600 and a second suggestion to unlock electronic lock 400 onentrance door 30 of the building. For example, when the user stateindicates that the user is currently cooking, and the urgent informationindicates that the delivery is non-urgent, processor 101 obtains, byreferring to third data 803 a in FIG. 5, a first suggestion to requestredelivery of item 40 and a second suggestion to receive item 40. Forexample, when the user state indicates that the user is not cooking, andthe urgent information indicates that the delivery is urgent, processor101 obtains, by referring to third data 803 a in FIG. 5, a firstsuggestion to unlock electronic lock 400 on entrance door 30 of thebuilding. In other words, in this case, processor 101 obtains a singlesuggestion. For example, when the user state indicates that the user isnot cooking, and the urgent information indicates that the delivery isurgent, processor 101 obtains, by referring to third data 803 a in FIG.5, a first suggestion to receive item 40 and a second suggestion torequest redelivery of item 40.

[Step S302]

Processor 101 of information processing server 100 causes displayterminal 200 to display at least one suggestion determined. For example,processor 101 transmits screen data including at least one suggestion todisplay terminal 200. Here, specific examples of a screen displayed bydisplay terminal 200 will be described with reference to FIG. 8 to FIG.12.

FIG. 8 illustrates an example of a first screen according toEmbodiment 1. The first screen is displayed when the user stateindicates that the user is currently cooking and the urgent informationindicates that the delivery is urgent.

As illustrated in FIG. 8, display 204 displays, in sequence from theleft to the right, camera image 211, image 212 of item 40, firstsuggestion 213 to turn off cooker 600, and second suggestion 214 tounlock electronic lock 400 on entrance door 30. Here, when an operationto select first suggestion 213 and/or second suggestion 214 isperformed, device control corresponding to the selected suggestion isperformed. That is to say, the screen of display 204 is segmented. Thescreen includes a region for displaying a camera image, a region fordisplaying the content of an item, and a region for displaying at leastone suggestion. Display 204 also displays, at the top, a current dateand time, a login user, and various states. The display of suchinformation is a mere example, and is not limited to this example.

Camera image 211, image 212 of item 40, and first and second suggestions213 and 214 are respectively displayed in three display regions arrangedhorizontally on display 204. Here, the three display regions areidentical in shape and size. Each of the three display regions is asquare region occupying about one third of the display area of display204. Note that being identical encompasses being substantially identicalas well as being strictly identical. In other words, being identicalmeans being approximately identical. Furthermore, a square encompasses aprecise square and shapes which can be considered substantiallyidentical to a precise square. For example, the screen may include threedisplay regions only. In a more limited example, the screen of display200 may only include three display regions that are identical in sizeand shape.

First suggestion 213 and second suggestion 214 are arranged next to eachother vertically. Here, first suggestion 213 is displayed with higherpriority by being displayed above second suggestion 214. Note that themethod for display with priority is not limited to the verticalarrangement. For example, first suggestion 213 may be displayed withhigher priority by being displayed in a different size or color.

Camera image 211, image 212 of item 40, and first and second suggestions213 and 214 may be displayed on display 204 simultaneously, for example.In other words, the three pieces of information may simultaneously startbeing displayed. Alternatively, for example, after camera image 211 isdisplayed, image 212 of item 40 and first and second suggestions 213 and214 may be displayed with camera image 211. This way, image 212 of item40 and first and second suggestions 213 and 214 are displayed after theuser recognizes camera image 211, thus assisting the user to grasp thecurrent situation in sequence. For example, when the user sees cameraimage 211 and recognizes that a delivery item has arrived, the userconsiders what to do next. By displaying image 212 of item 40 and firstand second suggestions 213 and 214 at this timing, it is possible toprovide the user with information appropriate to the user's situation.For example, since the user in, for example, a residence or an apartmentbuilding uses the system on a daily basis and becomes familiar with theinformation displayed on display 204, camera image 211, image 212 ofitem 40, and first and second suggestions 213 and 214 may be displayedsimultaneously if the user has used the system for a certain period orlonger. Examples of the certain period include one week, one month, andthree months. In the case of an office building, a commercial building,or a hotel, for example, the user may not use the system on a dailybasis, and thus may be unfamiliar with the information displayed ondisplay 204. In the case of an office building, a commercial building,or a hotel, for example, camera image 211 may be displayed first, andimage 212 of item 40 and first and second suggestions 213 and 214 may bedisplayed next, so that even the unfamiliar user can easily understandthe information. Note that although the example above is the case ofdisplaying image 212 of item 40 and first and second suggestions 213 and214 simultaneously, camera image 211, image 212 of item 40, and firstand second suggestions 213 and 214 may be separately displayedsequentially.

The following describes the meaning of camera image 211, image 212 ofitem 40, and first and second suggestions 213 and 214 included in thefirst screen. Camera image 211 is included to allow user 20 to recognizearrival of delivery person 50, when delivery person 50 arrives atentrance door 30 of the building. Image 212 of item 40 is included toshow the content of item 40 delivered by delivery person 50. This allowsuser 20 to recognize item 40 that is being delivered by delivery person50.

The first screen includes first suggestion 213 and second suggestion 214to provide guidance on the next action of user 20 in response to cameraimage 211 and image 212 of item 40. Because user 20 is highly likely toreceive item 40, first suggestion 213 and second suggestion 214 aredisplayed as the next action of user 20 determined based on image 212 ofitem 40. That is to say, first suggestion 213 and second suggestion 214are included based on the presumption that user 20 is highly likely toturn off cooker 600 and/or unlock electronic lock 400 to receive urgentitem 40.

In other words, the first screen includes camera image 301 and image 212of item 40 to allow user 20 to easily check item 40 delivered to user20. Further, the first screen includes first suggestion 213 and secondsuggestion 214 as the next action of user 20 determined based on cameraimage 301 and image 212 of item 40. By seeing the first screen, user 20can check, all at once, the arrival of delivery person 50 deliveringitem 40, the content of item 40, and the next action, and can then takean action.

FIG. 9 illustrates an example of a second screen according toEmbodiment 1. The second screen is displayed when the user stateindicates that the user is currently cooking and the urgent informationindicates that the delivery is non-urgent.

As illustrated in FIG. 9, display 204 displays, in sequence from theleft to the right, camera image 211, image 212 of item 40, firstsuggestion 215 to request redelivery of item 40, and second suggestion216 to receive item 40. Here, when an operation to select firstsuggestion 215 is performed, a third screen, which will be describedlater, is displayed on display 204, for example. On the other hand, whenan operation to select second suggestion 216 is performed, the firstscreen in FIG. 8 is displayed, for example.

By seeing the second screen, user 20 can check, all at once, the arrivalof delivery person 50 delivering item 40, the content of item 40, andthe next action, and can then take an action.

FIG. 10 illustrates an example of the third screen according toEmbodiment 1. The third screen is displayed after the user has selectedthe suggestion to request redelivery of item 40.

As illustrated in FIG. 10, display 204 displays, in sequence from theleft to the right, camera image 211, image 212 of item 40, and graphicaluser interface (GUI) 217 via which user 20 can select a redelivery timeand transmit a redelivery request to information terminal 500 ofdelivery person 50. User 20 can select a redelivery time by operatingGUI 217. For example, by pressing GUI 217, it is possible to transmit aredelivery request to information terminal 500, requesting deliveryperson 50 to redeliver item 40 after the selected number of hours. Thatis to say, a request for redelivery of item 40 is transmitted toinformation terminal 500 when a selection of the suggestion to requestredelivery of item 40 is received.

FIG. 11 illustrates an example of a fourth screen according toEmbodiment 1. The fourth screen is displayed when the user stateindicates that the user is not cooking and the urgent informationindicates that the delivery is urgent.

As illustrated in FIG. 11, display 204 displays, in sequence from theleft to the right, camera image 211, image 212 of item 40, and firstsuggestion 218 to unlock electronic lock 400 on entrance door 30. Here,when an operation to select first suggestion 218 is performed,electronic lock 400 is unlocked.

By seeing the fourth screen, user 20 can check, all at once, the arrivalof delivery person 50 delivering item 40, the content of item 40, andthe next action, and can then take an action.

FIG. 12 illustrates an example of a fifth screen according toEmbodiment 1. The fifth screen is displayed when the user stateindicates that the user is not cooking and the urgent informationindicates that the delivery is non-urgent.

As illustrated in FIG. 12, display 204 displays, in sequence from theleft to the right, camera image 211, image 212 of item 40, firstsuggestion 219 to receive item 40, and second suggestion 220 to requestredelivery of item 40. Here, when an operation to select firstsuggestion 219 is performed, the fourth screen in FIG. 11 is displayed,for example. On the other hand, when an operation to select secondsuggestion 220 is performed, the third screen in FIG. 10 is displayed,for example.

By seeing the fifth screen, user 20 can check, all at once, the arrivalof delivery person 50 delivering item 40, the content of item 40, andthe next action, and can then take an action.

[Step S303]

Processor 101 of information processing server 100 performs controlbased on the suggestion selected. For example, processor 101 transmitsan unlock signal to electronic lock 400 on entrance door 30 when displayterminal 200 receives a selection of the suggestion to unlock electroniclock 400 (second suggestion 214 in FIG. 8, for example). This way,electronic lock 400 is unlocked. For example, an OFF signal istransmitted to cooker 600 when display terminal 200 receives a selectionof the suggestion to turn off cooker 600 (first suggestion 213 in FIG.8, for example). This way, cooker 600 becomes non-operational. Whenentrance door 30 is an entrance door in a public space of, for example,an apartment building, an office building, or a commercial building,electronic lock 400 may be unlocked after a lapse of a first period orless, following the reception of the unlock signal. An example of thefirst period is a period required for communication, or a few seconds.However, when entrance door 30 is an entrance door leading directly to aprivate space such as a residence, an office, or a shop, delivery person50 can enter the private space before the user arrives at entrance door30, and thus, the user may not feel safe using the system. In view ofthis, as compared to electronic lock 40 on entrance door 30 to a publicspace, electronic lock 40 on entrance door 30 to a private space may beunlocked after a lapse of a second period which is longer than the firstperiod, following the reception of the unlock signal. An example of thesecond period is an average period required for the user to come toentrance door 30, or 30 seconds. Alternatively, the second period may beuser-settable. For example, in the case of a residence, the secondperiod may be set to a time period corresponding to the distance fromthe user to the kitchen.

Advantageous Effects, Etc.

As described above, in information processing system 10 according to thepresent embodiment, information processing server 100 can: (a) obtain,using sensor 700, a user state indicating whether user 20 is currentlycooking using cooker 600, when an image of delivery person 50 deliveringitem 40 to a building in which user 20 is present is captured by camera300 provided at entrance door 30 of the building; (b) obtain contentinformation of item 40; (c) obtain at least one suggestion associatedwith the user state and the content information of item 40; and (d)cause display terminal 200 provided in the building to display the imageof delivery person 50, the content information of item 40, and the atleast one suggestion.

This makes it possible to display, on display terminal 200, at least onesuggestion according to the user state and the content information ofitem 40. That is to say, at least one suggestion appropriate to user 20and item 40 can be presented to user 20. Moreover, since the contentinformation of item 40 can be displayed in addition to the image ofdelivery person 50, user 20 can determine the next action based on thecontent of item 40. Accordingly, when delivery person 50 delivering item40 arrives, it is possible to effectively present user 20 withinformation which assists user 20 in determining the next action. Ininformation processing system 10 according to the present embodiment,the content information of item 40 includes urgent informationindicating whether delivery of item 40 is urgent, and in (c), when theuser state indicates that user 20 is currently cooking and the urgentinformation indicates that the delivery is urgent, informationprocessing server 100 can obtain, as the at least one suggestion, asuggestion to turn off cooker 600 and a suggestion to unlock electroniclock 400 on entrance door 30 of the building.

With this, when item 40 of an urgent delivery arrives while user 20 iscooking, it is possible to effectively present the user with suggestionsof actions necessary for safely receiving item 40. That is to say, it ispossible to present user 20 with a suggestion of an action that reducesoccurrence of an accident with cooker 600 while inhibiting apostponement of reception of item 40 of the urgent delivery, and it ispossible to more effectively present user 20 with information whichassists user 20 in determining the next action.

In information processing system 10 according to the present embodiment,in (c), when the user state indicates that user 20 is currently cookingand the urgent information indicates that the delivery is non-urgent,information processing server 100 can obtain, as the at least onesuggestion, a suggestion to request redelivery of item 40 and asuggestion to receive item 40.

With this, when item 40 of a non-urgent delivery arrives while user 20is cooking, it is possible to present a suggestion to request redeliveryof item 40 and a suggestion to receive item 40, from which user 20 canselect the next action. That is to say, with reference to the contentinformation of item 40, user 20 can determine, for each item 40, whetherto request redelivery of item 40 or to receive item 40. In other words,information processing server 100 can more effectively present user 20with information which assists user 20 in determining the next action.

In information processing system 10 according to the present embodiment,in (c), when the user state indicates that user 20 is not cooking andthe urgent information indicates that the delivery is urgent,information processing server 100 can obtain, as the at least onesuggestion, a suggestion to unlock electronic lock 400 on entrance door30 of the building.

With this, when item 40 of an urgent delivery arrives while user 20 isnot cooking, it is possible to effectively present the user with asuggestion of an action necessary for receiving item 40. In such a case,user 20 is less likely to select, as the next action, request redeliveryof item 40, and thus, it is possible to more effectively present user 20with information which assists user 20 in determining the next action.

In information processing system 10 according to the present embodiment,in (c), when the user state indicates that user 20 is not cooking andthe urgent information indicates that the delivery is urgent,information processing server 100 can obtain, as the at least onesuggestion, a suggestion to receive item 40 and a suggestion to requestredelivery of item 40.

With this, when item 40 of an urgent delivery arrives while user 20 isnot cooking, it is possible to present a suggestion to receive item 40and a suggestion to request redelivery of item 40, from which user 20can select the next action. That is to say, with reference to thecontent information of item 40, user 20 can determine, for each item 40,whether to receive item 40 or to request redelivery of item 40. In otherwords, information processing server 100 can more effectively presentuser 20 with information which assists user 20 in determining the nextaction.

Note that although the content information of item 40 according to thepresent embodiment includes the urgent information, the contentinformation of item 40 is not limited to this. For example, the contentinformation of item 40 may include the type of item 40. For example, thetype of item 40 is fresh food, frozen food, or the like. In such a case,at least one suggestion is obtained based on the user state and the typeof item 40.

Note that the content information of item 40 in the present embodimentincludes an image of item 40; however, a product name of item 40 may beincluded instead of an image of item 40. The content information of item40 may include both an image of item 40 and a product name of item 40.

Note that the screens and data illustrated in the present embodiment aremere examples, and the present disclosure is not limited to theseexamples. For example, the display regions in which the three pieces ofinformation are displayed need not be identical in size and shape. Thecombinations of (i) a user state and an urgent flag and (ii) a firstsuggestion and a second suggestion, illustrated in FIG. 5, are a mereexample, and the present disclosure is not limited to this example.First suggestions and second suggestions different from those in FIG. 5may be associated with user states and urgent flags.

For example, as illustrated in FIG. 13, Unlock may be used as the firstsuggestion and Receive Later as the second suggestion. For example, asillustrated in FIG. 14, Cooker OFF may be used as the first suggestionand Receive Later as the second suggestion. For example, as illustratedin FIG. 15, Receive Now may be used as the first suggestion and SelectRedelivery Time as the second suggestion. For example, as illustrated inFIG. 16, Unlock & Cooker OFF may be used as the first suggestion andReceive Later as the second suggestion.

Note that the user states and the values of the urgent flag that lead tothe screen examples in FIG. 8 to FIG. 16 are not particularly limited,and any user state and any value of the urgent flag may lead to thescreen examples in FIG. 8 to FIG. 16.

Note that in the present embodiment, first data 801 a, second data 802a, and third data 803 a are referred to, however; the present disclosureis not limited to this. For example, first data 801 a need not bereferred to. In such a case, whether or not the user is currentlycooking may be directly determined based on the ON/OFF signal of cooker600, for example. Further, second data 802 a need not be referred to. Insuch a case, the content information of item 40 may be directly obtainedfrom a camera image, for example. Further, third data 803 a need not bereferred to. In such a case, third data 803 a may be hard coded.

Note that in the present embodiment, the processing order of the flowchart in FIG. 6 is a mere example, and the present disclosure is notlimited to this example. For example, Steps S201 and S202 may beperformed before Steps S101 and 102.

After the service providing system is used for a certain time period andafter Step S303 is finished, a selection screen may be displayed for theuser to select the user's preferred display mode for display 200 in StepS302, out of a display mode in which plural pieces of information aresequentially displayed in the display regions and a display mode inwhich plural pieces of information are simultaneously displayed in thedisplay regions. The display mode for Step S302 which is to be appliednext time the service is provided is determined based on the displaymode selected by the user.

Note that the user may be given a choice among the first to fifthscreens illustrated in FIG. 8 to FIG. 12. For example, the initialsetting may be the first screen, and after the processing of the flowchart illustrated in FIG. 6 is finished, display 200 may display, to theuser, the first to fifth screens and a message prompting the user toselect a screen which the user wishes to be displayed from next timeonward. From next time onward, suggestions are displayed to the userbased on the screen selected by the user. For example, the first tofifth screens are displayed in a temporal order. Further, whenprocessing is performed a certain number of times on the screen whichthe user has selected, display 200 may display again the first to fifthscreens and a message prompting the user to select a screen which theuser wishes to be displayed from next time onward. Examples of thecertain number of times include 10, 30, and 50. When the user isrepeatedly prompted to select a screen for every certain number of timesand the user successively selects the same screen, the user need not beprompted to select a screen after that.

Embodiment 2

Next, Embodiment 2 will be described. The present embodiment describes aservice providing system that provides a service including provision ofinformation on a screen to be displayed on a display terminal.

[Overview of Service Provided]

FIG. 17A illustrates an overview of a service providing system accordingto Embodiment 2.

Group 1000 may be, for example, a company, an organization, or ahousehold of any size. Group 1000 includes device A and device B thatare included in devices 1010, and home gateway 1020. Device A is, forexample, cooker 600 according to Embodiment 1. Devices 1010 includedevices connectable to the Internet (e.g., a smartphone, PC, and TV) anddevices unconnectable to the Internet by themselves (e.g., anillumination and a washing machine). Devices 1010 may include devicesthat are unconnectable to the Internet by themselves but are connectableto the Internet via home gateway 1020. Moreover, group 1000 includesusers 990A of devices 1010.

Data center operating company 1100 includes cloud server 1110. Cloudserver 1110 is a virtual server that operates in cooperation withvarious devices via the Internet. For example, cloud server 1110 isinformation processing server 100 according to Embodiment 1. Cloudserver 1110 mainly manages large data (big data) that is hard to handlewith ordinary database management tools or the like. Data centeroperating company 1100 manages data and cloud server 1110 and, forexample, operates a data center for the management. Service provided bydata center operating company 1100 will be specifically described later.In this case, data center operating company 1100 is not limited tocompanies that are only involved in data management and the operationetc. of cloud server 1110. For example, if a device manufacturer thatdevelops and manufactures one of devices 1010 also manages data andcloud server 1110, the device manufacturer is equivalent to data centeroperating company 1100 (FIG. 17B). Data center operating company 1100 isnot limited to a single company. For example, if a device manufacturerand another management company are involved in data management and theoperation of cloud server 1110 in a collaborative or shared manner, atleast one of the device manufacturer and the management company isequivalent to data center operating company 1100 (FIG. 17C).

Service provider 1200 possesses server 1210. In this configuration,server 1210 includes, for example, memory in a personal PC regardless ofthe size. The service provider may not possess server 1210.

In this service, home gateway 1020 is not mandatory. For example, ifcloud server 1110 totally manages data, home gateway 1020 is notnecessary. There are also cases where devices unconnectable to theInternet by themselves are not provided, as in the case where all thehome devices are connected to the Internet.

The flow of information in the service will be described below.

First, device A or device B of group 1000 transmits information obtainedin each device to cloud server 1110 of data center operating company1100. Cloud server 1110 accumulates information on device A or device B((a) of FIG. 17A). The accumulated information indicates, for example,the operating condition, the operation date and time, the operationmode, and the position of each device 1010. For example, the informationincludes but is not limited to the television viewing history,information on the recording schedule of a recorder, the operating dateand time of a washing machine, the amount of laundry, the date and timeof opening/closing of a refrigerator, the number of times ofopening/closing of a refrigerator, and the amount of foods in arefrigerator. Any kinds of information available from all the devicescan be used. Information may be directly provided to cloud server 1110from devices 1010 via the Internet. Alternatively, information may betemporarily accumulated in home gateway 1020 from devices 1010 and thenprovided to cloud server 1110 from home gateway 1020.

Next, cloud server 1110 of data center operating company 1100 providesservice provider 1200 with the accumulated information in constantunits. In this case, the constant units may be units in which the datacenter operating company can organize and provide the accumulatedinformation to service provider 1200 or units requested by serviceprovider 1200. The units need not be constant units. The amount ofinformation provided may vary depending on the circumstances. Wherenecessary, the information is stored in server 1210 provided in serviceprovider 1200 ((b) in FIG. 17A). Then, service provider 1200 organizesthe information suitably for user service and then provides theinformation to users. The users whom the information is provided to maybe users 990A of devices 1010 or external users 990B. The service may bedirectly provided to users from the service provider, for example ((e)and (f) of FIG. 17A). The service may be provided to users after passingthrough, for example, cloud server 1110 of data center operating company1100 again ((c) and (d) of FIG. 17A). Cloud server 1110 of data centeroperating company 1100 may organize the information suitably for userservice and then provide the information to service provider 1200.

User 990A and user 990B may be different from each other or identical toeach other.

Techniques described in the foregoing embodiments can be implemented by,for example, the following types of cloud service. However, types ofcloud service for implementing the techniques described in theembodiments are not limited to the following types:

[Service Type 1: Company-Owned Data Center] FIG. 18 illustrates servicetype 1 (company-owned data center). In this type, service provider 1200obtains information from group 1000 and provides service to users. Inthis type, service provider 1200 has the function of the data centeroperating company. Specifically, the service provider includes cloudserver 1110 that manages big data. Thus, data center operating companiesare not present.

In this type, service provider 1200 operates and manages data center 903(cloud server 1110). Moreover, service provider 1200 manages OS 902 andapplication 901. Service provider 1200 provides service 904 by using OS902 and application 901 that are managed by service provider 1200.

[Service Type 2: IaaS-Based]

FIG. 19 illustrates service type 2 (IaaS-based). IaaS stands forInfrastructure as a Service, which is a cloud service provision modelfor providing, as service via the Internet, an infrastructure forconstructing and operating a computer system.

In this type, data center operating company 1100 operates and managesdata center 903 (cloud server 1110). Moreover, service provider 1200manages OS 902 and application 901. Service provider 1200 providesservice 904 by using OS 902 and application 901 that are managed byservice provider 1200.

[Service Type 3: PaaS-based]

FIG. 20 illustrates service type 3 (PaaS-based). PaaS stands forPlatform as a Service, which is a cloud service provision model forproviding, as service via the Internet, a platform for constructing andoperating software.

In this type, data center operating company 1100 manages OS 902 andoperates and manages data center 903 (cloud server 1110). Moreover,service provider 1200 manages application 901. Service provider 1200provides service 904 by using OS 902 managed by the data centeroperating company and application 901 managed by service provider 1200.

[Service Type 4: SaaS-based]

FIG. 21 illustrates service type 4 (SaaS-based). SaaS stands forSoftware as a Service. For example, SaaS is a cloud service provisionmodel that enables a company/individual (user) who does not have a datacenter (cloud server) to use an application provided by a platformprovider having a data server (cloud server) via a network such as theInternet.

In this type, data center operating company 1100 manages application901, manages OS 902, and operates and manages data center 903 (cloudserver 1110). Service provider 1200 provides service 904 by using OS 902and application 901 that are managed by data center operating company1100.

In all of the types, service is provided by service provider 1200. Forexample, the service provider or the data center operating company maydevelop its own OS, application, or the database of big data etc., oroutsource the development to a third party.

Other Embodiments

While the foregoing has described an information processing systemaccording to one or more aspects of the present disclosure based onexemplary embodiments, the present disclosure is not limited to theseembodiments. Various modifications to these embodiments conceivable tothose skilled in the art, as well as embodiments resulting fromcombinations of constituent elements in different embodiments may beincluded within the scope of one or more aspects of the presentdisclosure, so long as they do not depart from the essence of thepresent disclosure.

For example, an aspect of the present disclosure may be a displaycontrol method which includes, as steps, not only processing performedby such an information processing system, but also processing performedby a processor included in the information processing system. Further,an aspect of the present disclosure may be a computer program whichcauses a computer to perform each characteristic step included in adisplay control method. Furthermore, an aspect of the present disclosuremay be a non-transitory computer-readable recording medium having such acomputer program recorded thereon.

Such a program causes a computer to (a) obtain, using a sensor, a userstate indicating whether a user is currently cooking using a cooker,when an image of a delivery person delivering an item to a building inwhich the user is present is captured by a camera provided at anentrance door of the building; (b) obtain content information of theitem; (c) obtain at least one suggestion associated with the user stateand the content information of the item; and (d) cause a displayterminal provided in the building to display the image of the deliveryperson, the content information of the item, and the at least onesuggestion.

In the present disclosure, part or all of the units and devices, or partor all of the functional blocks in the block diagram illustrated in FIG.2 may be implemented by one or more electric circuits including asemiconductor device, a semiconductor integrated circuit (IC), or alarge scale integration (LSI) circuit. LSI or IC may be integrated in asingle chip, or may be configured by combining a plurality of chips. Forexample, functional blocks other than memory elements may be integratedin a single chip. Although the names used here are LSI and IC, but theintegrated circuit may also be called a system LSI circuit, a very LSIcircuit (VLSI), or an ultra LSI (ULSI) circuit depending on the degreeof integration. A field programmable gate array (FPGA) programed aftermanufacturing of the LSI circuit or a reconfigurable logic device whichis reconfigurable in connection or settings of circuit cells inside theLSI circuit may be used for the same purpose.

Moreover, some or all of the functions or operations of the units,devices, or part of the devices can be performed through softwareprocessing. In such a case, software is recorded on a non-transitoryrecording medium such as one or more ROMs, optical discs, or hard diskdrives, and the software, when executed by a processor, causes theprocessor and a peripheral device to perform particular functions of thesoftware. The system or device may include one or more non-transitoryrecording media having software recorded thereon, a processor, and anecessary hardware device, such as an interface.

Although only some exemplary embodiments of the present disclosure havebeen described in detail above, those skilled in the art will readilyappreciate that many modifications are possible in the exemplaryembodiments without materially departing from the novel teachings andadvantages of the present disclosure. Accordingly, all suchmodifications are intended to be included within the scope of thepresent disclosure.

INDUSTRIAL APPLICABILITY

The present disclosure is applicable to an information processing systemwhich provides a user with a suggestion of an action to take when adelivery person with a delivery item arrives at a building in which theuser is present.

What is claimed is:
 1. A display control method performed using a systemincluding an information processing server, the display control methodcomprising: (a) obtaining, by the information processing server, using asensor, a user state indicating whether a user is currently cookingusing a cooker, when an image of a delivery person delivering an item toa building in which the user is present is captured by a camera providedat an entrance door of the building; (b) obtaining, by the informationprocessing server, content information of the item; (c) obtaining, bythe information processing server, at least one suggestion associatedwith the user state and the content information of the item; and (d)causing, by the information processing server, a display terminalprovided in the building to display the image of the delivery person,the content information of the item, and the at least one suggestion. 2.The display control method according to claim 1, wherein the contentinformation of the item includes urgent information indicating whetherdelivery of the item is urgent, and in (c), when the user stateindicates that the user is currently cooking and the urgent informationindicates that the delivery is urgent, the information processing serverobtains, as the at least one suggestion, a suggestion to turn off thecooker and a suggestion to unlock an electronic lock on the entrancedoor of the building.
 3. The display control method according to claim2, wherein in (c), when the user state indicates that the user iscurrently cooking and the urgent information indicates that the deliveryis non-urgent, the information processing server obtains, as the atleast one suggestion, a suggestion to request redelivery of the item anda suggestion to receive the item.
 4. The display control methodaccording to claim 2, wherein in (c), when the user state indicates thatthe user is not cooking and the urgent information indicates that thedelivery is urgent, the information processing server obtains, as the atleast one suggestion, a suggestion to unlock the electronic lock on theentrance door of the building.
 5. The display control method accordingto claim 2, wherein in (c), when the user state indicates that the useris not cooking and the urgent information indicates that the delivery isurgent, the information processing server obtains, as the at least onesuggestion, a suggestion to receive the item and a suggestion to requestredelivery of the item.
 6. The display control method according to claim1, wherein the sensor is provided in the building, and in (a), theinformation processing server obtains the user state based on a sensorvalue obtained by the sensor.
 7. The display control method according toclaim 6, wherein in (a), the information processing server obtains theuser state based on the sensor value by referring to first dataassociating a plurality of sensor values and a plurality of user states.8. The display control method according to claim 7, wherein the firstdata associates the plurality of sensor values and the plurality of userstates for each of a plurality of users, and in (a), the informationprocessing server identifies the user based on the sensor value, andobtains the user state based on the user identified and the sensor valueby referring to the first data.
 9. The display control method accordingto claim 1, wherein the content information of the item includes one ofa product name of the item and an image of the item.
 10. The displaycontrol method according to claim 1, wherein the image includesidentification information for identifying the content information ofthe item, and in (b), the information processing server obtains theidentification information from the image, and obtains the contentinformation of the item based on the identification information byreferring to second data associating a plurality of pieces ofidentification information and pieces of content information of aplurality of items.
 11. The display control method according to claim 1,wherein in (b), the information processing server obtains the contentinformation of the item based on a date and a time of obtainment of theimage, by referring to second data associating scheduled delivery datesand times and pieces of content information of items.
 12. The displaycontrol method according to claim 2, further comprising: (e)transmitting, by the information processing server, an unlock signal tothe electronic lock on the entrance door of the building when thedisplay terminal receives a selection of the suggestion to unlock theelectronic lock.
 13. The display control method according to claim 3,further comprising: (f) transmitting, by the information processingserver, a request for redelivery of the item to an information terminalusable by the delivery person, when the display terminal receives aselection of the suggestion to request redelivery of the item.
 14. Thedisplay control method according to claim 2, further comprising: (g)transmitting, by the information processing server, a control signal tothe cooker to turn off the cooker, when the display terminal receives aselection of the suggestion to turn off the cooker.
 15. The displaycontrol method according to claim 1, wherein in (c), the informationprocessing server obtains the at least one suggestion associated withthe user state and the content information of the item by referring tothird data associating (i) a plurality of combinations of a user stateand content information of an item and (ii) a plurality of suggestionsets each including at least one suggestion.
 16. An informationprocessing server, comprising: a processor; and memory, wherein usingthe memory, the processor: (a) obtains, using a sensor, a user stateindicating whether a user is currently cooking using a cooker, when animage of a delivery person delivering an item to a building in which theuser is present is captured by a camera provided at an entrance door ofthe building; (b) obtains content information of the item; (c) obtainsat least one suggestion associated with the user state and the contentinformation of the item; and (d) causes a display terminal provided inthe building to display the image of the delivery person, the contentinformation of the item, and the at least one suggestion.
 17. A displayterminal in a system, the system including an information processingserver and the display terminal, the display terminal comprising: aprocessor; and a display, wherein the information processing server: (a)obtains, using a sensor, a user state indicating whether a user iscurrently cooking using a cooker, when an image of a delivery persondelivering an item to a building in which the user is present iscaptured by a camera provided at an entrance door of the building; (b)obtains content information of the item; and (c) obtains at least onesuggestion associated with the user state and the content information ofthe item, and the processor of the display terminal: (d) obtains theimage of the delivery person, the content information of the item, andthe at least one suggestion; and (e) displays, on the display, the imageof the delivery person, the content information of the item, and the atleast one suggestion.